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ABSTRACT 


Applying  Spatial-Temporal  Model  and  Game  Theory  to  Asymmetric  Threat 

Prediction 


Accurate  predictions  of  enemy  course  of  actions  (ECOA)  are  important  to  the  command 
and  control  optimization  strategies  in  long-lasting  battles.  In  most  Command  and  Control 
(C2)  applications,  the  existing  techniques,  such  as  spatial-temporal  point  models  for 
ECOA  prediction  or  Discrete  Choice  Model  (DCM),  assume  that  insurgent  attack 
features/patterns,  or  at  least  the  trends  of  behavior  patterns,  are  static.  However,  this  static 
assumption  is  no  longer  true  for  intelligent  and  organized  insurgents  in  recent  anti¬ 
terrorism  war.  These  insurgents  sometimes  deliberately  violate  probability  theory 
predictions  so  they  can  apply  surprise  attacks  to  create  more  casualties  and  spread  terror. 

In  this  paper,  a  new  game  theoretic  framework  is  proposed  for  modeling  dynamic 
changes  of  enemy  behavior  features  and  predicting  future  threats.  This  framework 
semantically  combines  several  different  approaches;  namely,  a  feature  prediction  game, 
higher  level  hybrid  data  fusion,  techniques  to  provide  concrete  spatial-temporal  modeling 
and  prediction,  emotion  analysis  of  adversary  rationality  and  non-rationality,  deception 
identification  and  modeling,  hierarchical  knowledge  representation,  and  a  non-zero  sum 
stochastic  adversarial  Markov  game.  We  mainly  describe  the  modification  of  existing 
spatial-temporal  point  models,  the  fusion  of  dynamic  game  feature  selection  technique 
and  dynamic  cohesiveness  feature  selection  technique,  the  ontology  about 
selected/unselected  features,  and  construction  of  probability  predictions. 


1.  Introduction 


In  recent  years,  many  models  and  techniques  have  been  applied  to  symmetric  adversarial 
situations  such  as  wargaming  or  criminal  cases  with  plenty  of  prediction  results. 
However,  asymmetric  adversaries  faced  by  U.S.  forces  become  more  and  more  frequent 
and  satisfying  predications  are  still  quite  difficult  to  obtain.  With  a  belief  that  the  end 
justifies  the  means  and  not  constrained  by  some  basic  morality,  asymmetric  adversaries 
are  often  able  to  engage  surprise  attacks  and  successfully  disappear  before  U.S.  forces 
have  time  to  concentrate.  Adversaries’  ability  to  leam  and  adapt  their  attack  patterns  and 
the  often  unstructured  data  sources  such  as  ontology  information  complicate  this  problem 
even  more.  Infonnation  that  could  be  used  to  dynamically  identify  attack  patterns  and 
changes  of  patterns  and  predict  when-where-how  such  attacks  are  most  likely  to  happen 
will  greatly  benefit  U.S.  forces  by  reducing  such  surprise  attacks  to  non-surprising 
events. 

To  successfully  model  and  predict  the  adversaries’  most  likely  future  courses  of  actions 
(COAs),  automated  processing  techniques  that  identity  patterns  of  COAs  and  assess 
possible  future  threats  are  critical  needs.  By  dynamically  mining  and  analyzing  terrorists 
and  insurgents’  preferences  and  features  of  actions,  U.S.  forces  can  locate  dangerous  time 
slots  and  locations  more  accurately,  prepare  counterstrike  COAs,  or  at  least  mitigate  the 
impact  of  attacks.  At  the  same  time,  the  new  information  identified  can  be  automatically 
fused  to  the  existing  system  and  prediction  performance  will  be  improved. 

Liu  and  Brown  [11]  applied  extended  discrete  choice  models  to  prediction  of  spatial 
probability  of  criminal  activity,  which  produces  much  higher  accuracies  than  traditional 
hot-spotting  techniques.  The  fundamental  technique  utilized  by  Liu  and  Brown  is  to 
utilize  more  features  in  predictions.  However,  a  key  limitation  of  the  approach  is  that  the 
changes  in  the  subjects'  decision-making  processes  are  not  modeled.  This  is  to  say,  the 
subjects'  preferences  are  assumed  static. 

To  solve  such  problem,  a  new  framework  for  modeling  dynamical  changes  of  features 
and  predicting  future  threats  is  proposed.  In  this  framework,  techniques  that  can  provide 
concrete  spatial-temporal  modeling  and  prediction,  higher  level  hybrid  data  fusion, 
emotion  analysis  of  adversary  rationality  and  non-rationality,  deception  identification  and 
modeling,  hierarchical  knowledge  representation,  and  a  non-zero  sum  stochastic 
adversarial  Markov  game  are  combined  semantically. 

This  paper  is  organized  as  follows.  In  Section  II,  we  will  summarize  the  technical 
approach,  which  includes  problem  description,  the  refinement  of  spatial-temporal  models, 
the  feature  ontology,  the  fusion  of  different  feature  selection  techniques,  and  production 
of  probability  predictions.  Section  III  describes  the  experimental  results  and  explanations. 
Section  IV  provides  conclusions  for  the  paper. 


2.  Technical  Approach 

2,1  Framework 

The  new  framework  for  modeling  dynamical  changes  of  features  and  predicting  future 
threats  is  shown  in  Fig.  1 . 
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Fig.  1  Overall  System  Architecture 


Inputs  are  fed  into  the  data  refinement  (Level  0)  and  object  assessment  (LI)  data  fusion 
components.  The  refined  objects  and  related  pedigree  information  are  used  by  a 
feature/pattern  recognition  block  to  generate  primitive  prediction  of  intents  of  adversary 
asymmetric  threats.  If  the  observed  features  are  already  associated  with  adversary  intents, 
we  can  easily  obtain  them  by  pattern  recognition.  In  some  time-critical  applications,  the 
primitive  prediction  can  be  used  before  it  is  refined  by  relatively  time-consuming  high- 
level  data  fusion. 


High-level  situation  and  threat  refinement  (L2  and  L3)  data  fusion  based  on  a  Graphical 
Markov  game  model,  Hierarchical  Entity  Aggregation  (HEA),  Ontology,  and 
Hierarchical  Task  Network  are  proposed  to  refine  the  primitive  prediction  generated  in 
stage  1  and  capture  new  unknown  features,  which  will  be  associated  to  related  LI  results 
in  dynamic  learning  block.  In  the  dynamic  learning  model,  we  take  deception  reasoning, 
emotion  reasoning,  trend/variation  identification,  and  distribution  model  and  calculation 
into  account.  Our  approach  to  deception  detection  is  heavily  based  on  the  application  of 
pattern  recognition  techniques  to  detect  and  diagnose  what  we  call  out-of-normal 
conditions  in  the  battle  space.  Out-of-normal  conditions  are  enemy  activities  that  are  not 
deemed  as  a  part  of  the  normal  expected  evolution  of  systems.  The  results  of  dynamic 
learning  or  refinement  shall  also  be  used  to  enhance  L2  and  L3  data  fusion.  This  adaptive 
process  may  be  considered  as  process  refinement  (Level  4)  data  fusion. 

In  this  paper,  we  mainly  describe  the  modification  of  an  existing  spatial-temporal  point- 
model,  the  fusion  of  dynamic  game  feature  selection  technique  and  dynamic  cohesiveness 
feature  selection  technique,  the  ontology  about  selected/unselected  features,  and  building 
of  the  probability  predictions. 


2.2  Technical  Approaches 


A  typical  scenario  (Fig.  2),  an  urban  warfare  situation,  is  a  good  base  on  which  we  can 
illustrate  our  dynamic  adaptive  hierarchical  game  theoretic  approach  for  modeling  and 
prediction  of  asymmetric  threat  learning  processes.  Satellite  pictures  and  available 
topographic  information  provide  corresponding  data. 


Fig.  1 :  A  typical  scenario  of  urban  warfare 
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The  blue  force’s  mission  is  to  try  their  best  to  secure  the  entire  area,  including  the  urban 
districts,  bridges,  mains  roads  and  blocks,  as  shown  in  Fig.  1.  The  blue  ground  force 
consists  of  several  teams  of  soldiers  each  with  small  arms.  The  red  force  (terrorist  and/or 
insurgent  forces)  includes  several  armed  fighters  and  some  asymmetric  adversaries  hiding 
in  and  acting  like  the  white  objects  (the  civilians  and  vehicles).  The  red  forces  are 
equipped  with  small  arms,  mortar,  or  improved  explosive  devices  (IEDs).  We  assume 
there  is  an  asymmetry  in  total  forces  between  blue  side  and  red  side.  Blue  side  has  more 
soldiers  than  red  side.  Moreover,  the  objectives  of  blue  side  and  red  side  are  asymmetric: 
the  objectives  of  red  side  are  to  kill  blue  forces,  destroy  public  properties,  and  cause 
terror  without  considering  the  loss  of  themselves  and  the  consideration  of  collateral 
damage.  Usually,  they  will  attack  weakly  defended  or  undefended  targets  and  retreat 
before  blue  side  can  concentrate  for  a  counterstrike.  However,  in  this  situation,  red  force 
may  impose  some  “surprise”  attacks  that  might  be  chosen  deliberately  by  adversaries  to 
“violate”  the  predictions  based  solely  on  probability  theory.  In  other  words,  these  red 
forces  may  change  their  attack  pattern  and  modify  their  behavior  modes  purposefully. 
Based  on  this  scenario,  we  estimate  the  changes  in  enemy  strategies  even  before  such 
changes  have  been  fully  implemented.  We  give  out  a  primitive  estimation  of  ECOAs  by 
following  the  pattern/feature  recognition  model.  Based  on  such  prediction,  some 
associated  best  response  strategies  of  blue  side  actions  can  be  recommended. 


If  the  primitive  prediction  is  almost  correct,  there  are  two  possible  response  strategies  for 
the  blue  force,  according  to  different  goals.  If  at  this  time  the  blue  force’s  purpose  is  to 
stop  the  red  forces’  actions,  the  recommended  COA  of  blue  force  can  publicly  send  out  a 
message  (for  example,  to  focus  more  soldiers/policemen/ambulance  on  the  suspected 
areas,  to  put  a  news  on  a  newspaper  that  the  red  commander  will  read  for  sure,  and/or 


some  other  approaches)  to  intelligent  red  forces  telling  that  their  actions  are  in  the  control 
of  blue  side.  As  a  consequence,  probably  the  red  forces  will  refrain  from  the  actions. 
However,  if  the  purpose  of  blue  force  is  to  set  up  a  trap  and  catch  the  insurgents  so  that  in 
the  long  run,  the  total  number  of  attacks  will  go  down;  the  blue  force  can  only  do  soldier 
maneuvers  secretly.  In  other  words,  in  such  cases  not  only  the  red  might  do  deceptions, 
the  blue  might  also  perform  deception  actions.  If  the  first  guess  is  not  correct  (for 
example,  the  attack  pattern  is  new  and  unknown),  our  game  theoretic  data  fusion  module 
and  dynamic  learning  module  will  dynamically  refine  the  primitive  estimation  and  update 
the  feature/pattern  records. 

To  fuse  possible  features/patterns  into  prediction  techniques  and  game  feature  prediction 
and  selection,  we  must  first  identify  different  types  of  surprise  attacks  and  prepare 
possibly  related  features.  Only  after  knowing  which  type  of  attacks  will  happen  at  some 
next  stage  with  an  associated  probability,  a  better  resource  allocation  algorithm  is 
possible.  In  this  scenario,  considering  information  from  different  resources  (such  as 
papers,  newspapers,  reports  from  Department  of  Defense/Navy/Marine/Army/Air  Force), 
the  most  typical  surprise  attacks  are  stated  in  Table  1. 

Table  1  Types  of  typical  attacks 


Index 

Description 

1 

Gun  Fighter/Mortar/Small  Arms 

2 

IED  (Improvised  Explosive  Device) 

3 

Kidnap/Hijack 

4 

Robbery/Stealing 

5 

“Dirty”  bomber/Bio-attacks 

Table  1  is  based  on  common  sense  and  numerous  reports  about  the  on-going  anti¬ 
terrorism  wars.  Such  classification  is  typical  and  will  serve  as  the  initial  classification  and 
will  not  necessarily  be  fixed.  When  the  war  progresses,  new  types  of  actions  might  be 
added  and  out-of-date  types  might  be  dropped  (here  out-of-date  means  for  a  long  time 
period  there  is  little  or  no  attacks  are  observed).  This  is  actually  a  kind  of 
leaming/adaptation  and  will  be  implemented  dynamically  via  aggregation/clustering 
partitioning  techniques,  which  combine  our  hierarchical  aggregation  technique  [1-6]  and 
the  work  of  Milligan,  Cooper,  Mojena,  etc  [7-8].  According  to  different  requirements, 
predictions  about  the  overall  probability  that  an  “event”  will  occur,  predictions  about  the 
specific  probability  that  an  specific  attack  (such  as  IED)  will  occur,  and  predictions  about 
the  relative  probabilities  that  which  kind  of  attack  it  will  be  if  there  will  come  an  attack, 
can  be  produced. 

In  a  broad  sense,  any  possible  attribute  (or  feature)  might  be  related  to  another  attribute, 
which  means  any  attribute  can  serve  as  a  potential  feature  or  pattern.  However,  due  to 
real  world  limits  such  as  computation  requirements,  usually  we  can  only  choose  some 
measurable,  available,  and  “probably”  related  attributes/hypotheses  and  put  them  in  a 
pool  of  “raw  attributes.”  In  such  raw  attribute  pool,  there  might  still  exist  hundreds  or 
even  thousands  of  attributes,  which  would  greatly  exceed  the  computation  capability  of 


existing  computer  systems  since  each  attribute  will  serve  as  a  dimension  and  when  the 
number  of  attributes  increases  the  computation  will  be  daunting.  As  a  result,  before 
ingesting  features  into  the  system,  a  much  smaller  key  feature  set  should  be  dynamically 
selected  from  the  raw  attribute  pool.  A  subset  of  a  typical  raw  attribute  pool  is  stated  in 
Table  2. 


Table  2  The  attributes 


Index 

Description 

1 

Population  density  per  square  mile 

2 

Religion  hotness 

3 

Male  people  population  density  per  square  mile 

4 

Average  family  size 

5 

Young  people  (from  1 1  to  29)  population  density  per  square  mile 

6 

Average  salary  per  year 

7 

Average  income  per  person  per  year 

8 

Average  price  of  houses 

9 

Ratio  of  Children  in  school 

10 

Percentage  of  people  who  are  once  involved  in  drugs 

11 

Percentage  of  people  who  are  once  involved  in  crimes 

12 

Percentage  of  people  who  are  in  debt 

13 

Average  debt  per  person 

14 

Average  percentage  of  people  who  have  children 

15 

Average  age 

16 

Distance  to  nearest  soldier/policemen  station 

17 

Distance  to  nearest  hospital 

18 

Distance  to  nearest  fire  department 

19 

Distance  to  nearest  highway 

20 

Distance  to  nearest  church/school/library 

21 

Distance  to  nearest  park 

22 

The  time  difference  from  last  time’s  attack 

23 

Distance  to  nearest  occurred  attacks 

24 

Morale  of  insurgents 

25 

Average  of  wellness  of  public  utilities 

26 

Distance  to  nearest  lake/river/sea 

27 

Distance  to  nearest  desert/wood 

28 

Average  expenditure  on  alcohol  beverages,  tobacco,  and  smoking 

Note  that  the  24th  feature  “morale  of  insurgents”  is  not  like  other  features  and  not  easy  to 
measure  and  quantify,  although  it  is  very  important  in  almost  every  battle.  Here 
according  to  theories  [22-23]  about  sequential  game  and  social  networks  by  which  trust 
and  social  organization  can  be  developed,  we  choose  to  adapt  the  “anger  formula”  in  [9- 
1 0]  and  model  morale  as  follows 


(1) 


mn 

m(t )  =  m0  +  Y,  4  ih  )e~K  (t~h  ] 

i= 1 

Where  m0  is  the  initial  value  assigned  by  the  experienced  human  commanders,  N(t)  is 
the  total  number  of  attacks  occurred  since  the  beginning  of  battle  period  until  time  t ,  hj 
is  the  decay  factor  which  is  different  for  different  types  of  attacks,  and  ti  is  the  average 
of  starting  time  and  ending  time  of  the  i  th  attack.  At  is  calculated  as 


4  )  =  ai 


lb-lr 


L 


Rr  t. 


(2) 


Where  at  is  a  coefficient  pre-assigned  by  experienced  commanders  for  different  types  of 

attacks.  Zf  is  the  loss  of  Blue  for  i  th  attack.  Rf  is  the  resources  applied  by  Blue  for 

i  th  attack.  Since  the  superscript  R  is  for  Red,  Zf  and  R'1  can  be  explained  accordingly. 

T.  is  the  time  spent  for  i  th  attack.  When  the  time  goes  on,  an  occurred  attack  will  have 

less  and  less  influence  on  the  morale.  As  a  result,  and  to  save  the  computation  resources, 
when  its  influence  decays  to  a  considerable  sufficiently  small,  we  will  not  calculate  it  any 
more  in  later  time  stages. 


Similarly,  Table  2  only  serves  as  the  initial  raw  attribute  pool  and  the  raw  attribute  pool 
will  be  dynamically  updated,  for  no  one  knows  exactly  what  would  happen  next  stage. 
An  abnonnal  insurgent  might  even  choose  to  kill  only  the  driver  who  drives  a  car  with  a 
even  number  on  the  plate,  while  such  attribute  is  usually  considered  as  “minor”  and 
“irrelevant”  to  terrorism.  When  the  war  procedure  progresses  and  when  time  is  allowed, 
abnormal  situations  will  be  identified  and  studied  so  that  new  attributes  can  be  added  to 
the  raw  attribute  pool. 


The  feature  selection  procedure  is  shown  in  Fig  3,  which  will  automatically  selects 
features/pre ferences/attributes  for  future  event  probability  prediction.  To  avoid 
temporarily  removing  some  known  important  features  from  the  key  feature  set,  the  key 
feature  set  consists  of  two  parts:  Reserved  Feature  Subset  and  Selective  Feature  Subset. 
Reserved  feature  subset  is  composed  of  important  features  that  should  not  be  ignored  at 
any  time.  Selective  feature  subset  consists  of  the  features  automatically  selected  by  the 
feature  search  algorithm  stated  in  the  “Feature  selection”  dashed  block. 


Raw  attribute  pool 


> 


Resawed 
features  attributes 


Kev  feature  set 


Fig.  3.  Feature  Selection 


The  feature  selection  game  module  will  model  the  leaming/rationalizing  procedure  of 
players  and  produce  the  probabilities  that  different  features  will  be  selected  by  players  in 
next  stage.  For  k  th  feature,  its  output  is  denoted  as  P  ( k,tm  ) ,  which  means  the  predicted 

probability  that  the  k  th  feature  is  applied  for  attacks  by  Red  at  the  time  tm .  Details  of 

feature  selection  game  can  be  found  in  [21].  The  SSR  (Regression  Sum  of  Squares) 
module  will  produce  the  importance  describing  a  feature’s  capability  to  predict  the  whole 
existing  data  set  if  the  prediction  is  solely  based  on  this  feature.  The  result  of  SSR 
calculation  will  be  fused  with  the  result  of  cohesiveness  and  EWMA  adaptation  and 
produce  the  probabilities  as  if  the  battle  data  is  absolutely  non-organizational  (or 
random).  Fusing  the  probabilities  for  rational  situations  produced  by  feature  selection 
game  and  the  non-organizational  probabilities  produced  by  SSR,  cohesiveness,  and 
EWMA  (Exponentially  Weighted  Moving  Average  technique)  leaming/adaptation,  the 
selected  features  can  be  prioritized. 


For  feature  selection  game  module,  see  [21],  of  which  we  will  not  repeat  the  details  here. 
In  addition,  SSR’s  definition  and  calculation  can  be  found  in  every  textbook  about 
statistics  theory.  In  the  following  paragraphs,  we  will  focus  on  some  technical  details  of 
our  strategies  about  cohesiveness,  EWMA,  and  fusion  techniques. 

For  cohesiveness  calculation,  we  modified  the  traditional  algorithm  so  that  it  is  more 
suitable  for  feature  selection  than  the  traditional  approach  [11].  Denote  the  distance 


between  two  events  i  and  j  in  the  feature/attribute  space  as  cL  .  The  corresponding 
similarity  is  calculated  as  =1/(1 +ad..),  where  a  is  the  reciprocal  of  the  average  inter¬ 
event  distance.  The  tenn  used  to  measure  feature  cohesiveness  is  defined  as 


2E  i  bu 

i= 1  j=i+ 1 

n(n  -1) 


(3) 


Where  fy.  can  be  defined  as  fy  =  4a..(l-aiy)  .  n  is  the  number  of  occurred  events. 
Usually  smaller  values  of  y  implies  better  capability  of  the  feature  set  for  defining  the 


point  pattern.  Considering  the  prior  distribution  usually  deviates  from  uniform 
distribution,  the  adjusted  value  of  y  ,  denoted  as  y(t)  =  y  (Ek)/V  (Pk),  where  V  (Ek)  and 

Vg(Pk)  are  the  yg  scores  for  the  event  feature  data  set  Ek  and  the  prior  feature  data  set  pk 


respectively,  is  a  more  realistic  measurement  of  capability. 


Note:  we  do  not  simply  discard  features  as  Liu  and  Brown  [11]  do  for  “some  features 
that  do  not  exhibit  enough  variation  in  the  event  feature  data  set“.  In  [11],  Liu  and  Brown 
calculate 


max 

xik’*jk^Ek 

max 

*ik’xjkePk 


Xik~Xjk 


xik~xjk 


(4) 


and  discard  features  which  has  sufficiently  small  rk  .  This  is  because  from  the  view  of 

linear  prediction  or  a  traditional  point-model,  this  feature  might  not  be  easy  to  apply. 
However,  if  about  one  feature,  for  a  long  time  almost  all  events  are  fallen  in  a  very 
narrow  interval,  it  should  be  said  that  this  feature  has  prediction  capability  since  if  the 
feature  value  is  in  that  interval,  the  related  event-occurring  probability  will  be  high 
otherwise  is  low.  Actually  in  some  sense,  such  features  might  be  the  most  useful 
attributes  since  event  data  exhibit  strong  concentrations  about  it,  which  would  produce 
predictions  with  high  confidence. 


Our  approach  is  the  combination  of  the  game  theory  approach  and  the  spatial-temporal 
prediction  approach.  As  a  result,  it  is  applicable  to  apply  such  kinds  of  features.  For  this 
reason  and  to  save  calculation  time,  we  choose  to  select  features  according  to  the  overall 
result  of  the  feature  selection  block  in  Fig.  3,  thus  will  not  discard  a  feature/attribute 
simply  according  to  this  rk  rule. 


After  calculating  the  y  values,  Exponentially  Weighted  Moving  Average  technique 

(EWMA)  can  effectively  identify  the  on-going  features  and  learn  future  trends.  Before 
each  step  that  will  calculate  the  transition  density  functions,  an  additional  step  which  will 
choose  the  key  feature  set  specifically  for  this  step  is  added  and  will  produce  /  values 

for  all  features  in  the  space  corresponding  to  this  time  point.  Denote  the  adjusted  yg  value 
calculated  at  time  point  tm  for  feature  index  k  as  V<k)(tm)  ■  Define 

oo 

^(O  =  (/,)(! -Tf 


(5) 


where  A  is  the  exponentially  weighting  factor.  When  z(k\tm)  goes  out-of-control  lines 
calculated  via  probability  theory,  it  implies  that  there  might  be  a  pattern  change  or  feature 
variation.  Via  simulations,  a  set  of  feasible  A  can  be  detennined  according  to  different 
priorities  such  as  fast  detection  of  trend/variation,  reducing  false  alarms,  or  optimal 
balancing.  At  the  start-up  stage,  z{k\tx)  is  set  as  j/^fi,)  ■  The  reason  why  we  choose 

EWMA  is  that  EWMA  is  very  insensitive  to  the  common  assumption  “normality”  which 
is  abused  by  many  researchers.  A  second  reason  is  that  EWMA  is  notably  good  at 
supervising  small  trends  and  variations  under  situations  with  dynamics. 

To  fuse  the  results  from  cohesiveness  (adjusted  via  EWMA)  module  and  the  SSR 
module,  we  apply  the  following  formula 

P,(k,tJ  =  SSR(k,tJ/Zm(tJ  (6) 

The  higher  the  P2(k,tm )  is,  the  better  the  k  th  feature  is  for  prediction  at  the  time  tm .  The 
character  “D”  in  the  fusion  cross  (right  side  in  Fig.  2)  means  “division”. 


For  the  fusion  between  the  fused  output  P2(k,tm)  and  the  feature  selection  game  output 
P\k,tm ),  we  apply  the  following  formula  (equation  (7)).  The  higher  P(k,tm)  is,  the 
higher  the  probability  that  this  feature  will  be  selected  by  Red  in  next  stage. 

P(k,  tm  )  =  rUP1  (k,  tm  )  +  (1  -  r)UP2  ( k ,  tm  )  (7) 

Where  r  is  the  organizational  factor,  which  can  be  detennined  as 


r  = 


P  i 


Pi  +  P2 


(8) 


Where  pl  and  p2  are  the  p-values  (calculation  of  p-values  can  be  found  in  any  statistics 
textbook)  of  the  following  two  hypothesis  tests  (HT),  respectively 

1 1 /0  :  In  records  past  features  are  selected  by  Red  solely  according  to  game 

[Ha  :  In  records  past  features  are  not  selected  by  Red  solely  according  to  game 

I  H0  :  In  records  past  features  are  selected  by  Red  absolutely  randomly 

HT2 ;  j 

[Ha  :  In  records  past  features  are  not  selected  by  Red  absolutely  randomly 


In  other  words,  r  is  a  coefficient  reflecting  the  extent  of  the  Red  players’  abiding  by  the 
results  of  games.  This  is  because  when  Red  consists  of  many  non-organizational  agents, 
there  might  not  be  significant  planning  and  coordination  between  them,  which  makes  the 
occurrences  look  like  random  results.  In  addition,  when  the  number  of  agents  and  events 
increase,  the  results  will  be  more  and  more  like  a  random  distribution.  This  is  also  the 
basis  of  existing  traditional  probability  prediction  approaches.  However,  if  Red  agents  do 
have  strict  organization  and  do  have  perfect  coordination  and  planning,  no  matter  how 
large  their  number  is,  their  attacks  will  not  show  enough  randomness  since  each  of  their 
attacks  is  a  result  of  a  purposeful  selection,  not  a  result  of  random  assignment.  In 
addition,  r  is  also  a  sign  of  how  closely  related  the  future  pattern  and  existing  pattern 
are.  It  somewhat  likes  a  derivative  factor  (which  has  the  capability  of  “predicting”)  in 
PID  (Proportional-Integral-Derivative)  controllers,  although  not  exactly  the  same. 


Selected  features  will  be  put  into  the  inner  core  of  the  ontology  which  stores  the  features 
and  the  corresponding  structures/relationships  among  them.  A  brief  language- 
independent  diagram  about  the  dynamical  feature  ontology  maintenance  is  illustrated  in 
Fig.  4. 


Available  attributes /features 


Fig.  4.  Language-independent  feature  ontology  illustration 


Generally  when  inspecting  a  feature  and  checking  whether  it  should  be  chosen  or 
dropped,  an  inner-layer  feature  will  have  priority.  This  is  because  for  most  cases  inner- 
layer  features  are  more  “important”  and  there  are  also  some  hardships  when  transferring 
from  one  feature  set  to  another  feature  set,  which  results  in  some  “adhesiveness”  between 
different  stages.  For  outer-layer  features,  they  will  be  inspected  in  following  situations: 

(1)  Orders  from  human  commander  (if  any)  [Level  5  fusion  -  User  refinement], 

(2)  The  system  has  enough  leisure  time  after  computing  inner-layer  features. 

(3)  Existing  inner  features  can  not  model  the  behaviors  accurately  enough. 

Note  that  although  the  system  can  run  without  human  participation  once  initialized,  a 
human  commander  always  holds  the  highest  authority  for  every  step.  If  a  human 
commander  wishes  to  inspect  a  feature  that  is  at  the  very  outer  layer,  that  feature  would 
be  checked  before  any  inner-layer  features.  When  there  is  no  human  guide,  the  system 
will  dynamically  update  the  outer-layer  features  in  the  later  two  cases. 

Based  on  the  dynamic  feature  ontology,  spatial-temporal  models  can  be  built  up.  Kernel 
density  function  and  estimation  techniques  [For  details,  see  11-17]  are  applied  with  an 
important  correction.  That  is,  when  it  is  observed  that  the  event  initiators  are  intelligent 
and  will  not  try  to  initiate  a  new  event  right  after  last  occurred  event  at  exactly  the  same 
location,  we  will  choose  the  following  formula  (9)  as  the  kernel  density  function  instead 
of  traditional  Gaussian  functions  [14-15,  19]  or  Exponential  functions  [11-12]. 


(9) 


vv,  e  X{  (D'S  (D"’+1‘ 11 ,  when  UpperLimit  >  Dig  >  ( Dm  +  /) 

w2e  A‘  i(n‘"+l‘  )~D‘g\  when  LowerLimit  <  D.g  <  ( Din  +  /) 

Where  subscript  g  stands  for  the  map  grid  index,  n  is  the  index  of  past  event,  D  is  the 
feature  value,  i  is  the  index  of  feature,  and  wl ,  w2,  X\ ,  Xf  are  subject  to  the  following 
restriction: 

UpperLimit 

j  fJD«=  1  (10) 

LowerLimit 

lt  is  the  most  likely  distance  between  the  location  at  which  an  event  just  occurred  and  the 
location  at  which  a  next  location  would  happen.  The  initial  value  of  /(  is  assigned  by 
experienced  commander  and  later  (  can  be  automatically  updated  according  to  statistical 
event  data  obtained  in  the  process  of  long-time  battle.  When  the  feasible  feature  interval 

is  wide  enough  and  /.  is  not  close  to  the  ending  points  of  the  interval,  to  save  calculation 

resources,  the  UpperLimit  and  LowerLimit  can  be  set  as  +co  and  -oo ,  respectively. 

On  the  basis  of  the  kernel  functions,  spatial-temporal  prediction  model  can  be  built  and 
probability  predictions  can  be  produced.  The  predictions  the  prediction  results  of  Markov 
game  will  be  fused  according  to  the  following  fonnula 

P,  (c,  tm ,  x,  y)  =  rUP,!  (c,  tn ,  x,  y)  +  (1  -  r)UP;  (c,  tm ,  x,  y)  (11) 

Where  P](c,tm,x,y )  is  the  prediction  result  from  Markov  game,  P*(c,tm,x,y )  is  the 
prediction  result  from  spatial-temporal  model,  c  is  the  even  type  index,  tm  is  the  time,  x 
and  y  are  the  coordinates,  r  is  detennined  similarly  as  the  feature  selection 
organizational  factor.  For  the  Markov  gaming  details,  see  [18]. 

3.  Simulations  and  Experiments 

The  final  comprehensive  probability  prediction  results  (probability  maps)  in  a  long 
duration  battle  (which  can  be  divided  to  three  time-continuous  stages)  can  be 
demonstrated  in  following  figures  (Fig.  5,  Fig.  6,  Fig.  7),  which  are  based  on  the  scenario 
described  in  Fig.  2.  Indices  of  these  three  probability  prediction  maps  are  arranged  in 
time  sequence.  All  the  strategies  discussed  in  Section  2  are  fused  according  to  Fig.  1  to 
produce  the  ECOA  threat  probabilities  over  city  districts.  Over  the  time  horizon,  newly 
occurred  events  are  fed  to  the  system  to  update  the  identified  and/or  predicted  event 
features/patterns,  and  finally  update  the  probability  predictions. 

In  this  simulation  run,  the  corresponding  results  of  dynamic  feature  selection  are  listed  in 
the  following  Table  3.  The  feature  indices  are  defined  in  Table  2.  Note  that  the  number  of 
selected  features  might  change  according  to  time  thus  might  not  be  the  same. 

Table  3  Feature  selection  results  for  different  time  stages 


Fig.  5 

Fig.  6 

Fig.  7 

Feature  1 

Feature  1 

Feature  1 

Feature  7 

Feature  7 

Feature  7 

Feature  16 

Feature  16 

Feature  23 

Feature  23 

Feature  24 

Feature  24 

Feature  24 

In  this  simulation,  we  assume  feature  1  and  feature  2  are  in  the  reserved  feature  set  thus 
they  are  always  selected.  At  the  second  stage  feature  23  is  temporarily  removed  thus 
feature  16  (distance  from  soldier  stations)  has  a  stronger  influences  on  the  probability 
map.  This  is  reflected  in  Fig.  6  in  which  soldier  stations  have  larger  and  clearer  “safe 
boundaries”  compared  to  Fig.  5.  Note  that  feature  24  (the  morale  of  Red)  is  always 
selected.  Since  the  Blue  Force  successfully  assigns  the  soldier/policemen/weapon 
resources,  in  Fig.  7  the  Red  insurgents  have  lower  morale,  which  is  reflected  as  a  general 
lower  probability  to  have  a  event  for  most  location.  The  general  scope  of  the  river,  which 
is  generally  not  a  favorite  site  for  attacks  for  various  reasons,  is  also  reflected  in  all  three 
maps.  However,  it  is  still  possible  to  have  an  attack  on  the  river,  which  means  it  might 
occur  on  a  bridge,  a  boat,  etc. 


y  x 


Fig.  5  Probability  Map  for  stage  1 


0  x 

Fig.  6  Probability  Map  for  stage  2 
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Fig.  7  Probability  Map  for  stage  3 

A  simulation  about  event-occurring  is  shown  in  Fig.  8.  We  took  the  time  scope  of  the  last 
stage.  The  five  kinds  of  marks  in  Fig.  8  correspond  to  different  types  of  attacks,  which  is 
stated  in  the  following  Table  4. 

Table  4  Symbols  for  attack  types 


Index 

Description 

Symbol 

1 

Gun  Fighter/Mortar/Small  Arms 

Blue  star 

2 

IED  (Improvised  Explosive  Device) 

Green  circle 

3 

Kidnap/Hijack 

Red  Plus 

4 

Robbery/Stealing 

Cyan  square 

5 


“Dirty”  bomber/Bio-attacks 


Yellow  triangle  (down) 


Red  Fighter  3 

White  Objects 

Bridge  2 
Blue  Team  3 

Blue  Team  1 


^  Blue  Soldier 


Red  Fighter 


ill! 


White  Objects  White  Building 


Asymmetric  Threat 
with  Deception 


Fig.  8  The  event  occurrences  illustration 


4.  Conclusions 

In  this  paper,  we  refined  existing  spatial-temporal  point-model  prediction  techniques, 
combine  them  with  dynamic  feature  selection  game  model,  and  produce  dynamic 
probability  predictions.  The  features  are  stored  in  a  language-independent  ontology.  We 
modeled  and  studied  the  learning/adaptation  of  behavior  features  and  changing  emotional 
factors  in  hostile  environments.  The  advantages  of  our  proposed  algorithm  and 
architecture  are  demonstrated  in  a  typical  asymmetric  urban  warfare  scenario. 
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Why  do  we  need  features 


□  Very  early  prediction  models  (Model  Type  I) 

■  Calculate  the  crime  frequencies 

□  Later  models  (Model  Type  II) 

■  Analyze  possible  crime  preferences  or  features,  such 
as  pop.  Density,  income  per  cap,  distance  to  police 
station,  etc. 

■  Fuse  such  analyses  in  prediction,  typically 

□  Statistically  summarize  features 

□  Statistically  apply  features  in  probability  models 

■  Achieved  great  improvement  on  accuracy  of  city 
district  crime  predictions 

□  Thus  features  can  greatly  refine  the  predictions. 


Why  do  we  need  game  theory 


□  When  the  enemies  are  unorganized  and  non-intelligent, 
the  occurrences  of  Course  of  Action  (COAs)  will  be 
somewhat  independent,  which  might  make  the  whole 
scenario  fit  some  probability  models. 

□  However,  if  the  enemy  is  a  well-structured  and  has  an 
intelligent  organization,  the  scenario  will  be  largely 
different. 

■  Intelligent  enemy's  behavior  might  not  have  strong 
randomness. 

■  The  enemy  might  purposely  choose  COA  time  and  site, 
perform  such  COA,  calculate  the  loss  and  gain  of  last  stage, 
then  determine  the  next  stage's  action. 

■  If  necessary,  they  might  even  choose  a  different  site  for 
every  stage,  which  will  not  display  any  traditional 
"geographical  preference". 

□  That  is,  intelligent  enemy  might  (suddenly)  change 
preferences  or  behavior  features 


Why  do  we  need  game  theory 
(continued) 


□  Model  Type  II  assumes  that  the  features  are 
fixed  once  they  are  identified 

■  If  via  past  statistical  data  it  is  found  that  "the 
distance  to  gas  station"  is  an  effective  feature,  this 
feature  will  always  be  taken  into  account  even  if  later 
terrorists  change  their  pattern  so  that  "the  distance  to 
a  school"  becomes  the  new  effective  feature  for 
predicting  their  behaviors. 

■  The  reason  why  terrorists  wish  to  change  their 
behavior  pattern  is  that  they  find  that  policemen 
already  notice  the  old  feature  and  prepare  for  it  thus 
continuing  old  Course  of  Action  (COA)  pattern  will 
bring  too  high  risks. 


Why  do  we  need  game  theory 
(continued) 


□  Thus  Model  type  II  can  not  efficiently  deal 
with  possible  changes  of  COA  features. 

□  Even  if  the  model  is  modified  such  that  after 
each  time  step  the  effective  features  should 
be  chosen  again,  there  will  still  be  significant 
delay  in  identifying  such  changes  of  features, 
for  the  method  of  identifying  effective 
features  is  based  on  statistical  data  to  date. 

□  Only  after  the  changes  happen  long  enough  is 
it  possible  to  detect  such  changes,  not  to 
mention  predicting  such  changes. 


Why  do  we  need  game  theory 
(continued) 

□  Applying  game  theory  can  help  predict  possible  changes  of 
features 

■  This  is  because  the  basic  logic  of  game  theory  is  to 
predict  ahead  via  all  available  information,  including  past 
data  and  possible  choices  at  current  stage. 

■  It  does  not  need  to  wait  for  the  enemy's  change 
happening  first  thus  no  delay. 

■  In  addition,  such  prediction  is  often  self-enforcing  due  to 
the  properties  of  Nash  solutions  thus  is  more  trustable 

□  Via  game  theory,  it  can  be  anticipated  that  surprise  attacks 
will  be  reduced  for  many  surprise  attacks  will  not  be 
surprise  attacks  under  the  new  prediction  technique  fused 
with  game  theory. 


Our  Technical  Approach 


□  Our  approach  is  a  combination  of  game 
theory  approach  and  spatial-temporal 
prediction  approach. 

■  Feature  selection  Game 

provides  a  prediction  for  the  future  active 
features  that  a  player  would  choose 

■  Kernel  probability  functions 

improve  the  model  about  possible  actions 
of  non-organizational  insurgents. 


Advanced  Hybrid  Feature 
Selection  Approach 
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Raw  attribute  oool 
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Learning/  adaptation 


Feature  selection 


Organization  factor  fusion 


Selected  features 


Key  feature  set 


□  The  feature  selection  procedure  is 
used  to  automatically  select 
features/preferences/attributes  for 
future  event  probability  prediction. 

□  To  avoid  temporarily  removing 
some  known  important  features 
from  the  key  feature  set,  the  key 
feature  set  consists  of  two  parts: 

■  Reserved  Feature  Subset 

■  Selective  Feature  Subset 

□  Reserved  feature  subset  is 
composed  of  the  very  important 
features  which  should  not  be 
ignored  at  any  time. 

□  Selective  feature  subset  consists  of 
the  features  automatically  selected 
by  the  feature  search  algorithm 
stated  in  the  “Feature  selection” 
dashed  block. 


Cohesiveness  Calculation 


□  For  cohesiveness  calculation  we  slightly  modified  the  traditional 
algorithm  so  that  it  is  more  suitable  for  feature  selection  than 
traditional  approach. 


□  We  do  not  simply  discard  features  as  previous  researchers  did 
for  “some  features  that  do  not  exhibit  enough  variation  in  the 
event  feature  data  set”. 

High  concentration  does  not  always  mean  low  prediction  capability 
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Feature  Storage 


□  Selected 
features  will 
be  placed  in 
the  inner  core 
of  the 
ontology 
which  stores 
the  features 
and  the 
corresponding 
structures/rel 
ationships 
among  them. 


Available  attributes/features 


Raw  attribute  pool  < - Human 


Advantages  over  traditional 
probability  approaches 

□  Do  not  need  to  discard  features  “that  do  not  exhibit  enough  variation  in  the  event 
feature  data  set” 

■  Such  features  are  not  very  convenient  for  traditional  probability  estimation 
approach 

■  However,  high  concentration  does  not  necessarily  mean  low  prediction  capability 

■  Our  game  method  can  make  use  of  such  features 

□  Refined  kernel  probability  functions  in  estimation 

■  Problems  for  Traditional  Gaussian  distribution  approach  (use  last  event  feature 
value  as  the  center-point) 

□  Event  distribution  might  be  severely  asymmetric 

□  Many  feature  values  are  even  one  sided 

■  Problems  for  traditional  exponential  distribution  approach  (use  last  event  feature 
value  as  the  starting-point,  then  decreasing) 

□  An  intelligent  attacker  would  intuitively  avoid  exactly  the  same 
location/time/features 

□  Thus  last  time’s  feature  values  do  not  mean  the  highest  possibility 

■  Our  approach:  when  facing  such  problems,  use  double-sided  exponential  kernel 
distribution  as  the  kernel  probability  functions. 


y:  the  kernel  probability 


Illustration  of  the  approaches 


illustration  of  three  kernel  approximations 
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Simulation:  Urban  Warfare  Scenario 


□  In  a  typical  urban  warfare  scenario  (shown  below),  we  intend 
to  illustrate  our  dynamic  adaptive  hierarchical  game  theoretic 
approach  for  modeling  and  prediction  of  asymmetric  threat 
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Urban  Warfare  Scenario 


□  The  blue  force’s  missions  are  to  try  their  best  to  secure 
the  whole  area,  including  the  urban  districts,  bridges, 
mains  roads  and  blocks.  The  blue  ground  force  consists 
of  teams  of  soldiers/policemen  each  with  small  arms. 

□  The  red  force  (terrorist  and/or  insurgent  forces)  includes 
armed  fighters  and  some  asymmetric  adversaries  hiding 
in  and  acting  like  the  white  objects  (the  civilians). 

□  When  the  battles  are  long-lasting  and  the  battlefields  are 
heavily  populated  by  civilians,  civilians  sometimes  play 
important  roles  in  battles. 

■  Civilian  interest:  desire/enforcement  about  “participation” 

■  Civilian  intelligence:  capability  about  “participation” 

■  Biased  civilians  can  affect  COA  success  probabilities: 
asymmetric  information,  asymmetric  buildings,  asymmetric 
provisions,  etc. 


Urban  Warfare  Scenario: 
Detailed  Strategy  description 


□  In  urban  scenario,  we  predict  the  changes  in  enemy 
strategies  before  such  changes  are  fully  implemented. 

□  We  present  a  primitive  prediction  of  ECOAs  by  following 
the  pattern/feature  recognition  model. 

□  Based  on  such  prediction,  some  associated  best 
response  strategies  of  the  Blue  side  can  be 
recommended. 

□  If  the  primitive  prediction  is  almost  correct,  there  are 
two  possible  response  strategies  for  the  blue  force 
according  to  different  goals. 


Urban  Warfare  Scenario 


□  If  the  purpose  of  blue  force  is  to  stop  the  red  forces’  actions,  the 
recommended  COA  of  the  blue  force  is  to  publicly  send  a  message 
to  the  red  forces,  and  suggest  that  their  actions  are  in  the  control 
of  the  blue  side.  As  a  consequence,  probably  the  red  forces  will 
change  their  proposed  actions. 

□  However,  if  the  purpose  of  the  blue  force  is  to  set  up  a  trap  and 
catch  them  so  that  in  the  long  run  the  total  number  of  red  attacks 
will  go  down,  the  blue  force  can  only  maneuver  secretly. 

□  In  such  cases  not  only  might  the  red  use  deceptions,  the  blue  might 
also  use  some  counter  deceptions. 

□  If  the  first  guess  is  incorrect  (for  example,  the  attack  pattern  might 
be  new  and  unknown),  our  game  theoretic  data  fusion  module  and 
dynamic  learning  module  will  dynamically  refine  the  primitive 
prediction  and  update  the  feature/pattern  records. 


Urban  Warfare  Scenario:  features 


□  First  classify  and  identify  different  ECOAs  into  a  small  number 
of  types  of  surprise  attacks  with  associated  features. 

□  Only  after  deciding  which  type  of  attacks  will  likely  occur  at 
some  next  stage  with  what  probability,  can  we  develop  an 
appropriate  resource  allocation  algorithm. 

□  Considering  information  from  different  resources  (papers, 
newspapers,  reports  from  Department  of  Defense:  Navy, 
Marines,  Army,  Air  Force),  typical  surprise  attacks  are: 

■  Type  1:  Gun  Fighter/Mortar/Small  Arms 

■  Type  2:  IED  (Improvised  Explosive  Device) 

■  Type  3:  Kidnap/Hijack 

■  Type  4:  Robbery/Stealing 

■  Type  5:  “Dirty”  bomber/Bio-attacks 


Urban  Warfare  Scenario:  features 


□  In  a  broad  sense,  any  possible  attribute  (or  feature)  might  be 
related  to  another  attribute,  which  means  any  attribute  can  serve 
as  a  potential  feature  or  pattern. 

□  However,  due  to  real  world  limits  such  as  computation 
requirements,  usually  we  can  only  choose  some  measurable, 
available,  and  “probably”  related  attributes  and  put  them  in  a  pool 
of  “raw  attributes.” 

□  In  such  a  raw  attribute  pool  there  might  still  exist  hundreds  or  even 
thousands  of  attributes,  which  would  greatly  exceed  the 
computation  capability  of  existing  computer  systems  since  each 
attribute  will  serve  as  a  dimension,  and  when  the  number  of 
attributes  increases  the  computation  will  also  increase. 

□  As  a  result,  before  associating  features  into  the  system,  a  much 
smaller  key  feature  set  should  be  dynamically  selected  from  the 
raw  attribute  pool. 


Partial  List  of  Raw  Attribute  Pool: 
Example 


■  Population  density  per  square  mile 

■  Religious  intensity 

■  Male  people  population  density  per  square  mile 

■  Average  family  size 

■  Young  people  (from  11  to  29)  population  density  per  square  mile 

■  Average  salary  per  year 

■  Average  price  of  houses 

■  Ratio  of  children  in  school  and  out  ofschool 

■  Percentage  of  people  who  were  once  involved  in  crimes 

■  Percentage  of  people  who  are  in  debt 

■  Average  percentage  of  people  who  have  children 

■  Distance  to  nearest  soldier/policemen  station 

■  Distance  to  nearest  hospital 

■  Distance  to  nearest  highway 

■  Distance  to  nearest  church/school/library 

■  The  time  difference  from  the  previous  attack 

■  Distance  to  nearest  location  of  previous  attacks 

■  Morale  of  insurgents 

■  Average  wellness  of  public  utilities 

■  Distance  to  nearest  desert/wood 

■  Average  expenditure  on  alcohol  beverages,  tobacco,  and  smoking 


Simulation  results  for  the 
scenario 

□  The  final  comprehensive  probability  prediction  results 
(probability  maps)  in  a  long  duration  battle  (which  can 
be  divided  to  three  time-continuous  stages)  can  be 
demonstrated  in  following  figures. 

□  Indices  of  these  three  probability  prediction  maps  are 
arranged  in  time  sequence. 

□  All  the  strategies  discussed  are  fused  to  produce  the 
ECOA  threat  probabilities  over  city  districts. 

□  Over  the  time  horizon,  new  events  are  fed  to  the 
system  to  update  the  identified  and/or  predicted  event 
features/patterns,  and  finally  update  the  probability 
predictions. 


Simulations  for  Urban 
Warfare  Scenario 
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Explanations 


□  The  Red  insurgents  change  their  preferences  during  the  battle. 

□  However,  some  important  features  such  as  population  density 
and  morale  are  always  selected  (in  reserved  feature  set) 

□  With  the  help  of  the  fusion  of  feature  prediction  and  game 
theory,  the  Blue  Force  successfully  assigns  the 
soldier/policemen/weapon  resources.  In  the  last  figure  the  Red 
insurgents  have  lower  morale,  which  is  reflected  as  a  general 
lower  probability  to  have  a  event  for  most  location. 

■  Note  that  the  general  scope  of  the  river,  which  is  generally 
not  a  favorite  site  for  attacks  for  various  reasons,  is  also 
reflected  in  all  three  maps. 

■  However,  it  is  still  possible  to  have  an  attack  on  the  river, 
which  means  it  might  occur  on  a  bridge,  a  boat,  etc. 


Simulations  for  Urban 
Warfare  Scenario 
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Conclusions 


□  We  proposed  a  framework  for  asymmetric  threat 
learning/adaptation  detection  and  prediction. 

□  We  proposed  and  refined  advanced  hybrid  feature 
selection  strategy. 

□  We  fused  Markov  models  with  refined  spatial-temporal 
point  model  prediction  techniques  to  provide  specific 
ECOA  predictions. 

□  We  implemented  dynamic  learning  and  adapting 
techniques  and  fused  them  within  the  ontology. 

□  We  simulated  dynamic  predicting  system  in  which 
enemies  show  learning/adapting  abilities  and  various 
types  of  asymmetric  course  of  actions  (COA). 
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